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Abstract 

In this paper, we investigate the sum-capacity of the two-user Gaussian interference channel with Gaussian 
superposition coding and successive decoding. We first examine an approximate deterministic formulation of the 
problem, and introduce the complementarity conditions that capture the use of Gaussian coding and successive 
decoding. In the deterministic channel problem, we find the constrained sum-capacity and its achievable schemes with 
the minimum number of messages, first in symmetric channels, and then in general asymmetric channels. We show 
that the constrained sum-capacity oscillates as a function of the cross link gain parameters between the information 
theoretic sum-capacity and the sum-capacity with interference treated as noise. Furthermore, we show that if the 
number of messages of either of the two users is fewer than the minimum number required to achieve the constrained 
sum-capacity, the maximum achievable sum-rate drops to that with interference treated as noise. We provide two 
algorithms (a simple one and a finer one) to translate the optimal schemes in the deterministic channel model to 
the Gaussian channel model. We also derive two upper bounds on the sum-capacity of the Gaussian Han-Kobayashi 
schemes, which automatically upper bound the sum-capacity using successive decoding of Gaussian codewords. 
Numerical evaluations show that, similar to the deterministic channel results, the constrained sum-capacity in the 
Gaussian channels oscillates between the sum-capacity with Han-Kobayashi schemes and that with single message 
schemes. 

I. Introduction 

We consider the sum-rate maximization problem in two-user Gaussian interference channels (cf. Figure [T) under 
the constraints of successive decoding. While the information theoretic capacity region of the Gaussian interference 
channel is still not known, it has been shown that a Han-Kobayashi scheme with random Gaussian codewords 
can achieve within 1 bit/s/Hz of the capacity region |]5|, and hence within 2 bits/s/Hz of the sum-capacity. In this 
Gaussian Han-Kobayashi scheme, each user first decodes both users' common messages jointly, and then decodes 
its own private message. In comparison, the simplest commonly studied decoding constraint is that each user treats 
the interference from the other users as noise, i.e., without any decoding attempt. Using Gaussian codewords, 
the corresponding constrained sum-capacity problem can be formulated as a non-convex optimization of power 
allocation, which has an analytical solution in the two-user case ID. It has also been shown that within a certain 
range of channel parameters for weak interference channels, treating interference as noise achieves the information 
theoretic sum-capacity |[T], ||9l, ifTOl . For general interference channels with more than two users, there is so far 
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neither a near optimal solution information theoretically, nor a polynomial time algorithm that finds a near optimal 
solution with interference treated as noise ||2] llT2l . 

In this paper, we consider a decoding constraint — successive decoding of Gaussian superposition codewords — 
that bridges the complexity between joint decoding (e.g. in Han-Kobayashi schemes) and treating interference as 
noise. We investigate the constrained sum-capacity and its achievable schemes. Compared to treating interference 
as noise, allowing successive cancellation yields a much more complex problem structure. To clarify and capture 
the key aspects of the problem, we resort to the deterministic channel model 121 . In Q, the information theoretic 
capacity region for the two-user deterministic interference channel is derived as a special case of the El Gamal-Costa 
deterministic model |l6l, and is shown to be achievable using Han-Kobayashi schemes. 

We transmit messages using a superposition of Gaussian codebooks, and use successive decoding. To capture 
the use of successive decoding of Gaussian codewords, in the deterministic formulation, we introduce the comple- 
mentarity conditions on the bit levels, which have also been characterized using a conflict graph model in {H]. 
We develop transmission schemes on the bit-levels, which in the Gaussian model corresponds to message splitting 
and power allocation of the messages. We then solve the constrained sum-capacity, and show that it oscillates (as 
a function of the cross link gain parameters) between the information theoretic sum-capacity and the sum-capacity 
with interference treated as noise. Furthermore, the minimum number of messages needed to achieve the constrained 
sum-capacity is obtained. Interestingly, we show that if the number of messages is limited to even one less than 
this minimum capacity achieving number, the sum-capacity drops to that with interference treated as noise. 

We then translate the optimal schemes in the deterministic channel to the Gaussian channel, using a rate constraint 
equalization technique. To evaluate the optimality of the translated achievable schemes, we derive and compute two 
upper bounds on the sum-capacity of Gaussian Han-Kobayashi schemej^- Since a scheme using superposition 
coding with Gaussian codebooks and successive decoding is a special case of Han-Kobayashi schemes, these 
bounds automatically apply to the sum-capacity with such successive decoding schemes as well. We select two 
mutually exclusive subsets of the inequality constraints that characterize the Gaussian Han-Kobayashi capacity 
region. Maximizing the sum-rate with each of the two subsets of inequalities leads to one of the two upper bounds. 
The two bounds are shown to be tight in different ranges of parameters. Numerical evaluations show that the sum- 
capacity with Gaussian superposition coding and successive decoding oscillates between the sum-capacity with 
Han-Kobayashi schemes and that with single message schemes. 

The remainder of the paper is organized as follows. Section |ll] formulates the problem of sum-capacity with 
successive decoding of Gaussian superposition codewords in Gaussian interference channels, and compares it with 
Gaussian Han-Kobayashi schemes. Section HIH reformulates the problem with the deterministic channel model, and 
then solves the constrained sum-capacity. Section |IV] translates the optimal schemes in the deterministic channel 
back to the Gaussian channel, and derives two upper bounds on the constrained sum-capacity. Numerical evaluations 
of the achievability against the upper bounds are provided. Section [V] concludes the paper with a short discussion 
on generalizations of the coding-decoding assumptions and their implications. 



' Throughout this paper, when we refer to the Han-Kobayashi scheme, we mean the Gaussian Han-Kobayashi scheme, unless stated otherwise. 



Fig. 1. Two-user Gaussian interference cliannel. 



II. Problem formulation in Gaussian channels 

We consider the two-user Gaussian interference channel shown in Figure [T] The received signals of the two users 
are 

yi = hiixi + h2iX2 + zi, 

2/2 = h22X2 + hi2Xi + Z2, 

where {hij} are constant complex channel gains, and Zi ~ CA/'(0,iVi). Define gij = («, j = 1,2). 

There is an average power constraint equal to pi for the i*'* user (i — 1, 2). In the following, we first formulate the 
problem of finding the optimal Gaussian superposition coding and successive decoding scheme, and then provide 
an illustrative example to show that successive decoding schemes do not necessarily achieve the same capacity as 
Han-Kobayashi schemes. 

A. Gaussian Superposition Coding and Successive Decoding: a Power and Decoding Order Optimization 

Suppose the i*^ user uses a superposition of Li messages x[^\l < £ < Li). Denote by rf^ the rate of message 
. For a given block length n, for each message , a codebook of size 2'""; is generated by using IID random 
variables of CA/'(0, 1). The codebooks for different messages are independently generated. For the i*'* user, the 
transmit signal Xi is a superposition of Li Gaussian codewords, with its individual power constraint pi satisfied, 
i.e., 

Li . 

yPi 

Li 

X]pf^<P" » = 1'2. (1) 

The i*'* receiver attempts to decode all x\^\ d = 1, . . . , Li, using successive decoding as follows. It chooses a 
decoding order of all the Li + L2 messages from both users. It starts decoding from the first message in this 
order (by treating all other messages that are not yet decoded as noise,) then peeling it off and moving to the next 
one, until it decodes all the messages intended for itself — x[^\ £ = 1, . . . , i^. 
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Gaussian formulation 
(Section II, IV) 



Approximate 
modeling 



Capturing the key 
problem structure 



'T^pproximately optimal solutions^ 
(Algorithms 1 , 2) 
with optimality check 
(Theorem 3) 



Translate back to 
Gaussian channels 



Deterministic formulation 
(Section III, Appendix B) 




Analytical optimal solutions 
(Theorems 1, 2, 4, 5) 




Fig. 2. Our approach to solving problem (|3}. 



Denote the message that has order q in Oi by x[^^''f \ i.e., it is the ^q,;*'' message of the tq^i*^ user Then, the 
achievable rate for the successive decoding procedure to have a vanishingly small error probability as the block 
length n — > oo yields the following constraints on the rates of the messages: 

'.'^ < log 1 + ^ , Vl< g < max {order of xj in 0^}, ^ = 1, 2. (2) 

Now, we can formulate the sum-rate maximization problem as: 

2 Li 

max ^ ^ r|^^ (3) 



i=l,2 

subject to: ([B, (|2]). 

Note that problem ^ involves both a combinatorial optimization of the decoding orders {Oi} and a non-convex 
optimization of the transmit power {p\^^}- As a result, it is a hard problem from an optimization point of view 
which has not been addressed in the literature. 

Interestingly, we show that an "indirect" approach can effectively and fruitfully provide approximately optimal 
solutions to the above problem Instead of directly working with the Gaussian model, we approximate the 
problem using the recently developed deterministic channel model Q. The approximate formulation successfully 
captures the key structure and intuition of the original problem, for which we give a complete analytical solution 
that achieves the constrained sum-capacity in all channel parameters. Next, we translate this optimal solution in the 
deterministic formulation back to the Gaussian formulation, and show that the resulting solution is indeed close to 
the optimum. This indirect approach of solving (|3]l is outlined in Figure |2] 

Next, we provide an illustration of the following point: Although the constraints for the achievable rate region 
with Han-Kobayashi schemes share some similarities with those for the capacity region of multiple access channels, 
successive decoding in interference channels does not always have the same achievability as Han-Kobayashi schemes, 
(whereas time-sharing of successive decoding schemes does achieve the capacity region of multiple access channels.) 
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B. Successive Decoding of Gaussian Codewords vs. Gaussian Han-Kobayashi Schemes with Joint Decoding 

We first note that Gaussian superposition coding - successive decoding is a special case of the Han-Kobayashi 
scheme, using the following observations. For the 1** user, if its message xf\l < € < ii) is decoded at the 
2nd receiver according to the decoding order O2, we categorize it into the common information of the 1''* user. 
Otherwise, is treated as noise at the 2"'' receiver, i.e., it appears after all the messages of the 2"^^ user in O2, 
and we categorize it into the private information of the 1^* user The same categorization is performed for the L2 
messages of the 2"^* user Note that every message of the two users is either categorized as private information or 
common information. Thus, every successive decoding scheme is a special case of the Han-Kobayashi scheme, and 
hence the capacity region with successive decoding of Gaussian codewords is included in that with Han-Kobayashi 
schemes. 

However, the inclusion in the other direction is untrue, since Han-Kobayashi schemes allow joint decoding. In 
the following sections, we will give a characterization of the difference between the maximum achievable sum-rate 
using Gaussian successive decoding schemes and that using Gaussian Han-Kobayashi schemes. This difference 
appears despite the fact that the sum-capacity of a Gaussian multiple access channel is achievable using successive 
decoding of Gaussian codewords. In the remainder of this section, we show an illustrative example that provides 
some intuition into this difference. 

Suppose the i*'' user (i — 1, 2) uses two messages: a common message x1 and a private message x^. We consider 
a power allocation to the messages, and denote the power of x1 and ccf by q1 and gf, (i = 1,2.) Denote the 
achievable rates of and x^ by and rf . In a Han-Kobayashi scheme, at each receiver, the common messages 
and the intended private message are jointly decoded, treating the unintended private message as noise. This gives 
rise to the achievable rate region with any given power allocation as follows: 
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In a successive decoding scheme, depending on the different decoding orders applied, the achievable rate regions 
have different expressions. In the following, we provide and analyze the achievable rate region with the decoding 
orders at receiver 1 and 2 being {xl —?■ X2 x^) and {x2 — > xl — > X2) respectively. The intuition obtained with 
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Han-Kobayashi 
- Successive Decoding 




qP/n^ in dB 



Fig. 3. Illustrations of the difference between the achievable sum-rate with Han-Kobayashi schemes and that with successive decoding of 
Gaussian codewords. 



these decoding orders holds similarly for other decoding orders. With any given power allocation, we have 

rl < min flog(l + ^ f ), log(l + ^^H^^)) , (11) 

< min flog(l + f ),log(l + p ^ ^''^ ^ )) , (12) 

V 92+5l2('?J+'?l)+^2 9^+52192+^1 / 

rl < log(l + |i— -), rf < log(l + f-—). (13) 

52192 + ^1 .9l29l + ^2 

It is immediate to check that ( fTTI ) ^ (T3[ ^ (|4|i ^ (fTOl i. but not vice versa. 

To observe the difference between the constrained sum-capacity with (HJi ^ ( fTOl i and that with (fTTT i ^ ( fT3T l. we 
examine the following symmetric channel, 

511 = 322 = 1, 512 = 521 = 0.17, A^i = iV2 = 1, (14) 

in which we apply symmetric power allocation schemes with qf = and = (jfj, and a power constraint of 

P = Pi = 9f + 9f = 1000, i^l,2. 

Remark 1: Note that SHR ^ ^^ = 1000 ~ 30dB, INR = ^ = 170 - 22MB ^ « t- As indicated 

Ni ' logSNR 4 

in Figure 19 of ||3], under this parameter setting, simply using successive decoding of Gaussian codewords can have 
an arbitrarily large sum-capacity loss compared to joint decoding schemes, as SNR — > cxd. 

We plot the sum-rates with the private message power qf sweeping from nearly zero (-30dB) to the maximum 
(30dB) as in Figure [3] As observed, the difference between the two schemes is evident when the private message 
power qf is sufficiently smaller than the common message power q'[ (with qf + qf = 1000.) The intuition of why 
successive decoding of Gaussian codewords is not equivalent to the Han-Kobayashi schemes is best reflected in the 
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case of = 0. In the above parameter setting, with = 0, (|4|i ^ ( fTOl ) translate to 



rl + T'i< log(l+^mHi^) = 10.19 hits, (15) 

iVi 

< log(l + ^i^) 7.42 bits, rl < log(l + = 7.42 6i<s, (16) 

whereas (fTTT l ~ (flJl l translate to 

< min{log(l + ^^), log(l + ^)} = min{2.78, 7.42} = 2.78 tos, (17) 

52192 + ^^1 

rS < niin{log(l + ^ ), log(l + ^^)} = min{2.78, 7.42} 2.78 bits. (18) 

gmi + N2 Ni 

As a result, the maximum achievable sum-rates with the Han-Kobayashi scheme and that with the successive 
decoding scheme are 10.19 bits and 5.56 bits respectively. Here, the key intuition is as follows: for a common 
message, its individual rate constraints at the two receivers in a successive decoding scheme (fTTT l. ( fTSl i are tighter 
than those in a joint decoding scheme (|8]l, (|9]l. In the following sections, we will see that the constraints ( fTTT l. (fT2T l 
lead to a non-smooth behavior of the sum-capacity using successive decoding of Gaussian codewords. Finally, we 
connect the results shown in Figure |3] to the results shown later in Figure [TT] of Section IIV-CI 

Remark 2: In Figure [5] the optimal symmetric power allocation for a Han-Kobayashi scheme and that for a 
successive decoding scheme are Qi/Ni = 6.2dB and lA.5dB respectively, leading to sum-rates of 11.2 bits and 
10.2 bits. This result corresponds to the performance evaluation at a = iog(SNR^) ^ ^'"^^ ™ Figure [TT] 

III. Sum-capacity in deterministic interference channels 

A. Channel Model and Problem Formulation 

In this section, we apply the deterministic channel model 111 as an approximation of the Gaussian model on the 
two-user interference channel. We define 

(19) 
(20) 
(21) 
(22) 

where gij = gij/Nj are the channel gains normalized by the noise power Without loss of generality (WLOG), we 
assume that nu > 71,22. We note that the logarithms used in this paper are taken to base 2. Now, riji counts the 
bit levels of the signal sent from the i*'' transmitter that are above the noise level at the j"* receiver Further, we 
define 

Si = nil -n2i = - log(^), S2 = n22 - ^12 = - log(^), (23) 
ffii 322 

which represent the cross channel gains relative to the direct channel gains, in terms of the number of bit-level 
shifts. To formulate the optimization problem, we consider {nji} to be real numbers. (As will be shown later in 
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At Rx1 At Rx2 

nil n22 




Fig. 4. Two-user deterministic interference channel. Levels A and B interfere at the 1"' receiver, and cannot be fully active simultaneously. 



Remark |5] with integer bit-level channel parameters, our derivations automatically give integer bit-level optimal 
solutions.) 

In Figure m the desired signal and the interference signal at both receivers are depicted, yu and yi2 are the sets 
of received information levels at receiver 1 that are above the noise level, from users 1 and 2 respectively. y2i and 
1/22 are the sets of received information levels at receiver 2. A more concise representation is provided in Figure |5] 
« The sets of information levels of the desired signals at receivers 1 and 2 are represented by the continuous 
intervals /i = [0,nii] and I2 = [nn — 7122, «ii] on two parallel lines, where the leftmost points correspond 
to the most significant (i.e., highest) information levels, and the points at correspond to the positions of 
the noise levels at both receivers. 
« The positions of the information levels of the interfering signals are indicated by the dashed lines crossing 

between the two parallel lines. 
Note that an information level (or simply termed "level") is a real point on a line, and the measure of a set of 
levels (e.g. the length of an interval) equals the amount of information that this set can carry. The design variables 
are whether each level of a user's received desired signal carries information for this user, characterized by the 
following definition: 

Definition 1: fi{x) is the indicator function on whether the levels inside li carry information for the z*^ user 

{1 , if x G /, , and level x carries information for the i*'' user, 
(i = l,2.) (24) 
0, otherwise. 

As a result, the rates of the two users are i?i J^"" fi{x)dx, R2 ~ /q"" f2{x)dx. For an information level x s.t. 
Ji{x) = 1, we call it an active level for the i*'* user, and otherwise an inactive level. 

The constraints from superposition of Gaussian codewords with successive decoding (fTTI ) ^ (fTSl l translate to the 
following Complementarity Conditions in the deterministic formulation. 

/i(a;)/2(a; + (5i) = 0,V-cx)<a;<cx), (25) 
/2(a;)/i(a; + (52) = 0,V-oo<a;<oo, (26) 
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Fig. 5. Interval representation of the two-user deterministic interference cliannel. 



where Si and 62 are defined in ( l23T l. The interpretation of (l25t and (l2&t are as follows: for any two levels each from 
one of the two users, if they interfere with each other at any of the two receivers, they cannot be simultaneously 
active. For example, in Figure |4] information levels A from the 1"* user and B from the 2'"^ user interfere at the 
1"* receiver, and hence cannot be fully active simultaneously. These complementarity conditions have also been 
characterized using a conflict graph model in ifTTI . 

Remark 3: For any given function fi{x), x G every disjoint segment within Li with fi{x) = 1 on it corresponds 
to a distinct message. Adjacent segments that can be so combined as a super-segment having fi{x) = 1 on 
it, are viewed as one segment, i.e., the combined super-segment. Thus, for two segments si = [a, b] e /; and 
S2 ~ [c,d] G Ii,{b < c, ) satisfying fi{x) = l,Va; G si U .S2, if 3xo G {b,c),f{xo) = 0, then si,S2 separated by 
the point xq have to correspond to two distinct messages. 

Finally, we note that 

( l25T l f2{x)fi{x - = 0, V - 00 < X < c», 
and <^ fi{x)f2{x - (52) = 0, V - 00 < .t < 00. 
Thus, we have the following result: 

and < correspond to the same set of complementarity 

82 =b y §2 = -a 

conditions. 

We consider the problem of maximizing the sum-rate i?*'"™ = + R2 of the two users employing successive 
decoding, formulated as the following continuous support (infinite dimensional) optimization problem: 

prill 

max (i?™™=)/ h{x) + ,f2{x)dx (27) 

fl(x),f2(x) Jq 

subject to (l24]i, (|26] |. 

Problem dZTl i does not include upper bounds on the number of messages Li, L2. Such upper bounds can be added 
based on Remark[3] We will analyze the cases without and with upper bounds on the number of messages. We first 
derive the constrained sum-capacity in symmetric interference channels in the remainder of this section. Results are 
then generalized using similar approaches to general (asymmetric) interference channels in Appendix IB] 
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B. Symmetric Interference Channels 

In this section, we consider the case where nn = 7i22,"-i2 = "■21- Define a = = I — a. WLOG, we 

normalize the amount of information levels by nu, and consider nu — n22 — 1, and ni2 — n2i — a. Note that in 
symmetric channels, P = 61 ^62. 

Now, dZSl l (|26] | becomes 

/i(a;)/2(a; + /3) 0,V- 00 < a; < 00, (28) 
f2ix)fiix + /3)=0,y-oo<x<oo. (29) 

Problem (l27T i becomes 

max (i?^"" /'/i(-^) + /2(a:)d.T (30) 

/l(a:),/2(a:) Jo 

subject to (I24li,(l28]l,(l29ll. 

From Lemma [T] it is sufficient to only consider the case with /3 > 0, i.e. a < 1. 

We next derive the constrained sum-capacity using successive decoding for a G [0, 1], first without upper bounds 
on the number of messages, then with upper bounds. We will see that in symmetric channels, the constrained 
sum-capacity i?""™* is achievable with Ri = R2. Thus, we also use the maximum achievable symmetric rate, 
denoted by R{a) as a function of a, as an equivalent performance measure. R{a) is thus one half of the optimal 
value of 

1) Symmetric Capacity without Constraint on the Number of Messages: 

Theorem 1: The maximum achievable symmetric rate using successive decoding, (i.e., having constraints ([28] l. 
(|29]i), R{a) {a e [0, 1]), is characterized by 

. R(a) = 1 - §, when a = n = 0, 1, 2, . . .. 

. R{a) = i, when a = ^^,n = 1, 2, 3, . . .. 

• In every interval [ ^^"-^ , 2^+2 ]' — 0' 1' 2, . . ., R{a) is a decreasing linear function. 

• In every interval [ ^^~^ , 2n+i '\' n = 1,2,3, .. R{a) is an increasing linear function. 
. i?(l) = i. 

Remark 4: We plot R{a) in Figure |6] compared with the information theoretic capacity ||3]. 
The key ideas in deriving the constrained sum-capacity are to decompose the effects of the complementarity 
conditions, such that the resulting sub-problems become easier to solve. 
Proof of Theorem [7} 

i) When < a < tt^, n = 1,2,3,..., < /3 < 77-. We divide the interval [0, 11 into 2n + 1 segments 

^ 2n — 2n+l ' 7 : ; ; 2n+l — ^ 2n L ' J o 

{si, . . . , S2n+i}, where the first 2n segments have length /3, and the last segment has length 1 — 2n/3 G (0, 2,1+1 ] 



symmetric capacity using successive decoding 
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Fig. 6. The symmetric capacity with successive decoding in symmetric deterministic interference channels. 



(cf. Figure |7]) With these, the complementarity conditions ( |28] | (|29] | are equivalent to the following 

Vxe si(^:c + /3e S2),/i(x)/2(x + /3) = 0, 
VX e S2(^ x + /3 G S3)j2{x)Mx + 13)^0, 

V.T e S2n-l{<=> X + I3£ S2„), fl{x)f2{x -f /?) = 0, 

and Vx + I3e S2„+i, f2{x)fi{x + /3) = 0, 

(Relations ( ISTT l and ( |32] | correspond to the shaded strips in Figure |7]) 
Similarly, 

V.T eSi{^X + l3e S2)j2{x)h{x + /?) = 0, 

Vx e .S2(^ X + /3 G S3), /i(x)/2(x /3) = 0, 

V.T G S2„-i(^ a; + ^ G S2n)j2{x)fi{x + P) = 0, 
and V.T + /3 G .S2„+i, h{x)f2{x + /?) = 0. 
We partition the set of all segments into two groups: 

f/i = si U S3 U . . . U S2ri-i-i and C/2 = S2 U S4 U . . . U S2„. 

Note that 

• (EB and ( |32] | are constraints on fi{x) with support in Qi, and on /2(a;) with support in Q2- 
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• ( [33] ) and ( [34b are constraints on with support in Q2, and on f2{x) with support in C^i. 

Consequently, instead of viewing the (infinite number of) optimization variables as /i(a;)|[o,ii and f2{x)\[o,i]' 
more convenient to view them as 

Ci = {/i(2^)lei,/2(a;)|eJ and C2 = {/i(a::)|e2>/2(a::)|ei}, (35) 

because there is no constraint between Ci and C2 from the complementarity conditions. In other words, Ci and 
€■2 can be optimized independently of each other Define 

RhT^ [ /i(^)da;+ / f2{x)dx, 

RcT= [ /i(^)d^+ / f2ix)dx. 
Clearly, i?*"™ = + Rq^- Hence ( [30b can be solved by separately solving the following two sub-problems: 



and 



max [RhT^) fiix)dx+ f2ix)dx (36) 

fi{x)\giJ2{x)\g2 Jg^ 

subject to (EH), dlB, (©, 



max (iJS:'"^) / h(x)dx+ [ f2{x)dx (37) 

/i(a:)ls2'/2(^)ISl " Jg2 Jgi 

subject to ([33ll, ( [34] ). 



We now prove that the optimal value of (|36] l is i?^™* ~ 1 — 

• (Achievability:) 1 — is achievable with /i(a;) = l,Va; G Qi, and /2(a:^) = 0, S ^2- 
. (Converse:) dlB ^ Vi G {1, 2, . . . , n}, /^^^_^ fiix)dx + J^^^ f2{x)dx < (3 

f h{x)dx+ j f2{x)dx=J2if h{x)dx+ f !2{x)dx)+ j h{x)dx 

•^Gl J <d2 j— 1 Js2i-1 J S2i J S2i+1 

</3 • 71 + (1 - 2?i/?) = l- nl3. (38) 
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Fig. 



Segmentation of the infonnation levels, „ ^" , < a < ^Hil. 



By symmetry, the solution of ( |37] i can be obtained similarly, and the optimal value is i?^™* = 1 — n/3 as well. 
Therefore, the optimal value of ^ is i?™™* 2(1 - n/3). 
As the above maximum achievable scheme is symmetric, i.e., 

1, yxeGi 

(39) 

^ 0, \fxeg2 

the symmetric capacity is 

R{a) = 1 - n/3 = + 1 - n. (40) 



Clearly, R{a) is an increasing linear function of a in every interval ( , ^^•^".^ j, n = 1, 2, 3, .... It can be verified 
that R{a)\'2r^ = i, and i?(Q;)|_2^ = 1 " f ■ 

ii) When < a < n 0, 1, 2, . . . , i^^;^ < P < Similarly to i), we divide the interval [0, 1] into 

2?! + 2 segments {si, . . . , S2n+2}, where the first 2n + 1 segments have length /3, and the last segment has length 
1 — (2n + l)/3 G (0, 2n+2 ^ Figure [U. Then, the complementarity conditions ( |28] l, ( |29] l are equivalent to the 
following: 



(ED, m and /i(.t)/2(x + /3) = 0, Vx + /3 e S2„+2, 
and (O,® and /2(x)/i(a; + /3) = 0, Vx + /3 £ S2„+2. 



(41) 
(42) 



Similarly to i), with Qi = si U S3 U . . . U S2n+i and Q2 = S2 U S4 U . . . U S2,i+2, (l30l l can be solved by separately 
solving the following two sub-problems: 



max (i?£r-) / h{^)dx+ / /2(a;)dx 



(43) 



subject to (111, (O, (133, (ED, 



14 



and 

max (RhT^)f h{x)dx+ f f2{x)dx (44) 

/i(2:)ls2:/2(3:)lsi Jg2 JQi 

subject to (EH), ([31, dUl). 
We now prove that the optimal value of (l43l l is (71 + 1)/?: 

> (Achievability:) (n + l)/3 is achievable with fi{x) = l,Va; G ^/i, and f2{x) = 0,Va; G (72- 
. (Converse:) (EB,!!!]!,® ^Vi e {1,2,..., n + 1}, /^^^_^ /i(a;)da; + j^^j2{x)dx<p 

n n 'n~\~ 1 /I n 

=> / /i(.T)da;+ / f2ix)dx^J2( / /i(a;)d2:+ / hix)dx) 

<{n + l)p. (45) 

By symmetry, the solution of ( l44l i can be obtained similarly. Thus, the optimal value of (|30] | is 2(71 + The 
maximum achievable scheme is also characterized by (|39), and the symmetric rate is 



R{a) ^ {n + l)(5 ^ -{n+l)a + n+l. (46) 

Clearly, R{a) is a decreasing linear function of a in every interval ( ■> 2n+2 ^^ tt. = 0, 1, 2, . . .. It can be verified 
that R(a)\^ = 1 - and i?(a)|2„+i = i. 

iii) It is clear that i?(0) = 1, which is achievable with fi{x) = f2{x) = l,Va; G (0, 1), and R{1) — \, which is 

^. ^, ^ ^ . , /i(a:) = l, XG[0,1] / /i(x)=0, x G [0, 1] 

achievable by time sharing and < ■ 

/2(x)=0, XG [0,1] [ /2(a:) = l, x G [0, 1] 

We summarize the optimal scheme that achieves the constrained symmetric capacity as follows: 
Corollary 1: When a G (0, 1), the constrained symmetric capacity is achievable with 

{1, Vx G Gi 
(47) 
0, Va;Gg2 

where Gi = Uj=i,2,... and 02 = Ui=i,2,... «2i- 

In the special cases when a — (n = 1, 2, 3, . . . , ) and a = 1, the constrained symmetric capacity drops to 

. f /i(a;) = 1, a- G [0, 1] f /i(a;) =0, x€ [0, 1] 

^ which is also achievable by time sharing < and < 

[ /2(x)=0, XG [0,1] [ f2{x)^l, XG [0,1] 

We observe that the numbers of messages used by the two users — -Li, L2 — in the above optimal schemes are 

as follows: 

Corollary 2: 

. whenaG (22-^,2H±i),(7. = 1,2,3,...), L,^L2 = n+l; 

. when a G [0, i], a = (71 = 1, 2, 3, . . .), or a = 1, Li = L2 = 1- 

Remark 5: In the original formulation of the deterministic channel model 121, {n^ } are considered to be integers, 
and the achievable scheme must also have integer bit-levels. In this case, a = — is a rational number As a result, 

' rill ' 
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the optimal scheme ( |47] i will consist of active segments Qi that have rational boundaries with the same denominator 
nil. This indeed corresponds to an integer bit-level solution. 

From Theorem [T] (cf. Figure |6), it is interesting to see that the constrained symmetric capacity oscillates as a 
function of a between the information theoretic capacity and the baseline of 1 /2. This phenomenon is a consequence 
of the complementarity conditions. In Section |V] we further discuss the connections of this result to other coding- 
decoding constraints. 

2) The Case with a Limited Number of Messages: 

In this subsection, we find the maximum achievable sum/symmetric rate using successive decoding when there are 
constraints on the maximum number of messages for the two users respectively. Clearly, the constrained symmetric 
capacity achieved with a G [0, 1] will be lower than R{a). We start with the following two lemmas, whose proofs 
are relegated to Appendix [A] 

Lemma 2: If there exists a segment with an even index S2i (« > 1) and S2i does not end at 1, such that 

fi{x) = l,\/x <E S2i, or J2{x) = 1,V2; e S2i, 

(with fi{x) defined as in (|24|,) then i?™" < 1. 

Lemma 3: If there exists a segment with an odd index S2i-i (« > 1), such that 

fl{x) = 0,V.T G S2i-1, or f2{x) = 0,\fx G S2i-1, 

then i?*"™ < 1. 

Recall that the optimal scheme ( |47] | requires that, for both users, all segments in Q2 are fully inactive, and all 
segments in Qi are fully active. The above two lemmas show the cost of violating ( |47] |: if one of the segments in Q2 
becomes fully active for either user (cf. Lemma |2}, or one of the segments in Qi becomes fully inactive for either 
user (cf. Lemma |3]l, the resulting sum-rate cannot be greater than 1 . We now establish the following theorem: 

Theorem 2: Denote hy Li{i = 1, 2) the number of messages used by the i*'' user. When a G { '^^~^ , 2n+2 ^' ^ 
1,2,...,) if ii < n or L2 < n, the maximum achievable sum-rate is 1. 
Proof: WLOG, assume that there is a constraint of ii < n. 

i) First, the sum-rate of 1 is always achievable with 

/i(a;) = l,/2(.T)=0,V.TG[0,l]. 

ii) If there exists S2i, I < i < n, such that either fi{x) = 1, V.t G S2i, or f2{x) = 1, Vx G 821, then from Lemma 
12] the achieved sum-rate is no greater than 1 . 

iii) If for all S2i,l < i < n, there exists Xj in the interior of S2i such that fi{xi) = 0: 

Note that Xi separates the two segments S2i-i, S2i+i for the I'** user. From Remark|3] S2i-i and S2i+i have to 
be two distinct messages provided that both of them are (at least partly) active for the I'** user On the other hand, 
there are 71 + 1 such segments Qi = {si, S3, ... , S2n+i} (cf. Figures [T] and [8]l, whereas the number of messages of 
the 1** user is upper bounded by Li < n. Consequently, 31 < ii < 77, + 1, such that /i(a;) = 0,Va; G S2ii-i- In 
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(a) Maximum achievable symmetric rate with Li < 2. (b) Maximum achievable symmetric rate with Li < 3. 

Fig. 9. The symmetric capacity with a limited number of messages. 

Other words, there must be a segment in Qi that is fully inactive for the 1** user By Lemma |3] in this case, the 
achieved sum-rate is no greater than 1 . ■ 
Comparing Theorem |2] with Corollary |2] we conclude that if the number of messages used for either of the 
two users is fewer than the number used in the optimal scheme (|47] | (as in Corollary |2]i, the maximum achievable 
symmetric rate drops to i. This is illustrated in Figure [9(a)] with Li < 2 (or L2 < 2), and in Figure [9(b)| with 
Li < 3 (or L2 < 3). 

Complete solutions (without and with constraints on the number of messages) in asymmetric channels follow 
similar ideas, albeit more tediously. Detailed discussions are relegated to Appendix |B] 

IV. Approximate Sum-capacity for Successive Decoding in Gaussian Interference Channels 

In this section, we turn our focus back to the two-user Gaussian interference channel, and consider the sum-rate 
maximization problem (|3]l. Based on the relation between the deterministic channel model and the Gaussian channel 
model, we translate the optimal solution of the deterministic channel into the Gaussian channel. We then derive 
upper bounds on the optimal value of and evaluate the achievability of our translation against these upper 
bounds. 

A. Achievable Sum-rate Motivated by the Optimal Scheme in the Deterministic Channel 

As the deterministic channel model can be viewed as an approximation to the Gaussian channel model, optimal 
schemes of the former suggest approximately optimal schemes of the latter In this subsection, we show the 
translation of the optimal scheme of the deterministic channel to that of the Gaussian channel. We show in detail 
two forms (simple and fine) of the translation for symmetric interference channels: 

511 = 322,512 = 921, Ni = N2,Pl ^P2=P- 
The translation for asymmetric channels can be derived similarly, albeit more tediously. 
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1) A simple translation of power allocation for the messages: 

Recall the optimal scheme for symmetric deterministic interference channels (Corollary [T]) as plotted in Figure 
[TOl xf\i — 1, . . . , L represent the segments (or messages as translated to the Gaussian channel) that are active 
for the i*^ user Recall that 

-/3 = =^21 -nu =log(^). (48) 

511 

Thus, a shift of (3 to the right (i.e. lower information levels) in the deterministic channel approximately corresponds 
to a power scaling factor of in the Gaussian channel. Accordingly, a simple translation of the symmetric optimal 
scheme (cf. Figure [TOl i into the Gaussian channel is given as follows: 
Algorithm 1: A simple translation by direct power scaling. 

Step 1: Determine the number of messages Li = L2 = L for each user as the same number used in the 

optimal deterministic channel scheme. 
Step 2: Let ^ ^ ^ ^ . . . = = (fll)^' normaHze the power by ELiP^^^ = P- 



2) A finer translation of power allocation for the messages: 

In this part, for notational simplicity, we assume WLOG that the noise power Ni = N2 = 1 and 911 = 1. We 
consider the case where the cross channel gain is no greater than the direct channel gain: < gi2 < ga- 
in the optimal deterministic scheme, the key property that ensures optimality is the following: 

(I) 

Corollary 3: A message x] that is decoded at both receivers is subject to the sajne achievable rate constraint 
at both receivers. 

For example. In the optimal deterministic scheme (cf. Figure [TO] l, message x^^^ is subject to an achievable rate 
constraint of IxJ^'j at the I''* receiver, and that of \x\^^\ at the 2"'' receiver, with \x\^^\ = {x^^'^l = (3. In general, 
a;^"'^'' , . . . , x^^ and x^2^ , • • ■ , x^2" are the messages that are decoded at both receivers, whereas x^^"* , x'"^^ are 
decoded only at their intended receiver (and treated as noise at the other receiver) 

According to Corollary |3] we show that a finer translation of the power allocation for the messages is achieved 
by equalizing the two rate constraints for every common message (_x'f'\ . . . ,x\'"~^\i — 1,2). (However, rates of 




Fig. 10. The optimal scheme in the symmetric deteiTninistic interference channel. 
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different common messages are not necessarily the same.) 

As the I'** step of determining the power allocations, we give the following lemma on the power allocation of 
a;'^"* (with the proof found in Appendix let: 

Lemma 4: 

1) If p < ^~gi^^ , then L = 1, and x^^^^x^'') is treated as noise at the 2"'^{V*) receiver, with p^^^ = p. In this 
case, there is only one message for each user (as its private message.) rate constraint equalization is not needed. 

2) If p > ^—S^, then L >2, and a;!^"* (a;!^') are decoded at both receivers. To equalize its rate constraints at both 
receivers, we must have 

P^'^-l-.9i2 + (l-.g?2)P (<P)- (49) 

Next, we observe that after decoding a;^^'' , a;2^^ at both receivers, determining p'^^ for a;^' , x^^^ can be transformed 
to an equivalent P* step problem with p ^ p — p^^^: solving the new p'^^ of the transformed problem gives the 
correct equalizing solution for p*^^' of the original problem. In general, we have the following recursive algorithm 
in determining L and p^^\ . . . jP*^^-*. 

Algorithm 2, A finer translation by adapting L and the powers using rate constraint equalization. 

Initialize L = \. 

Step 1: If p < ^—P^, then p^^-* <— p and terminate. 

Step 2: p(^) ^ 1 - .912 + (1 - .gi2)p- L^L + l. p ^ p - p'^). Go to Step 1. 

Numerical evaluations of the above simple and finer translations of the optimal scheme of the deterministic 
channel into that of the Gaussian channel are provided later in Figure [TT] 

B. Upper Bounds on the Sum-capacity with Successive Decoding of Gaussian Codewords 

In this subsection, we provide two upper bounds on the optimal solution of ^ for general (asymmetric) channels. 
More specifically, the bounds are derived for the sum-capacity with Han-Kobayashi schemes, which automatically 
upper bound the sum-capacity with successive decoding of Gaussian codewords (as shown in Section III-BI ) We 
will observe that the two bounds have complementary efficiencies, i.e., each being tight in a different regime of 
parameters. 

Similarly to Section III-BI we denote by x^ the private message of the i*'* user, and x1 the common message 
(i = 1, 2.) We denote qi to be the power allocated to each private message a;^, i = 1,2. Then, the power of the 
common message x1 equals p; — qi. WLOG, we normalize the channel parameters such that gn = 922 = 1- Denote 
the rates of x^ and x1 by and r|. The sum-capacity of Gaussian Han-Kobayashi schemes is thus the following: 

max r'{ + rl + rl+ (50) 
91,92 

s.t. dUi - (Hoi. 

To bound dSOl l. we select two mutually exclusive subsets of the constraints: ( fTOb j and {^}- Then, with 
each subset of the constraints, a relaxed sum-rate maximization problems can be solved, leading to an upper bound 
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to the original constrained sum-capacity ( |50] l. 

The first upper bound on the constrained sum-capacity is as follows (whose proof is immediate from (|4) and 

cnii): 

Lemma 5: The sum-capacity using Han-Kobayashi schemes is upper bounded by 

opti ^ max mm | log(l H — ) + log(l H rrr)' 

91.92 32192 +iVi 51291 + jV2 

, , P2 +5l2(Pl - 9l)^ , 1 , 9l N 1 .^is 

+ —iTj ) + log(l + — — ) |. (51) 

31251 +iV2 ff2l92+A'l 

Computation of the upper bound ( 151b ; 
Note that 

, /I , Pi +ff2i(p2 - 92)^ , , , 92 s 

+ — T7 ) + log(l + — r- 

52192 + Ni gi2qi + N2 

= log(ci) - log(.g2i92 + Ni) - log(5i2gi + iV2) + log(ffi29i + 92 + ^^2), (52) 

. , /I , P2 +gi2{pi - 9i)n , 1 , 91 N 
and log(l + — )+log(l + — — ) 

31291 + jV2 .92192 +A'i 

= log(c2) - log(gi2gi + N2) - log(52l92 + ^1) + log(g2i92 + 9l + ^i), (53) 

where ci = A^i + pi + 321^2, C2 = A^2 + P2 + 5i2Pi- Clearly, the minimum of (|52| | and (|53] |) is 

- log(52i92 + Ni)- log(.gi2(7i + N2) (54) 

+ log (min{ci (,91291 + 92 + ^2), C2(,92i92 + 9i + ^i)})- 

Now, consider the halfspace (91,92) G 7^ defined by the linear constraint 

Cl (.91291 + 92 + -^^2) < C2(.92l92 + 91 + ^1) (Cl.9l2 - C2)9l < (C2.g21 - Ci)92 + C2iV"i - CiiV2- (55) 

In n, 

= log(ci) - log(g2i92 + Ni) - log(.gi29i + ^^2) + log(gi29i + 92 + ^^2) = /(9i,92)- (56) 

Note that ^'^g^^''^^"' < 0,V9i > 0. Thus, depending on the sign of cigi2 — C2, we have the following two cases: 

Case 1: Ci.gi2 — C2 > 0. Then, ( fSSl l gives an upper bound on 91. Consequently, to maximize ( |56] |. the optimal 
solution is achieved with 91 = 0. Thus, maximizing (|56] | is equivalent to 

max - log(52i92 + ^1) + log(92 + ^^2) (57) 

92 

s.t. < 92 < P2, (58) 

in which the objective (|57] | is monotonia, and the solution is either 92 = or 92 = P2- 
Case 2: Cigi2 — C2 < 0. Then, dSST l gives a lower bound on 91, 

^ (Cl - C2.92l)92 + CiiV2 - C2A^1 

91 > ■ (59) 

C2 - Cigi2 
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Consequently, to maximize ( |56] l, the optimal solution is achieved with qi = (^i~^2g2i)g2+cijV2-c2jVi ^ ^jjj^-jj jg ^ 



linear function of 52- Substituting this into (l56l l. we need to solve the following problem: 

max - log(aig2 + 61) - log(a2q2 + ^2) + \og{a3q2 + 63) (60) 
92 

S.t. < (72 < P2, 

where 0^,6;, (i = 1,2,3) are constants determined by 01,02,512,321,-^1,-^2- Now, (I6OI 1 can be solved by taking 
the first derivative w.rt. q2, and checking the two stationary points and the two boundary points. 

In the other halfspace TL'^, the same procedure as above can be applied, and the maximizer of ( |54] i within H'^ 
can be found. Comparing the two maximizers within TL and H'^ respectively, we get the global maximizer of (ISTT i. 

■ 

The second upper bound on the constrained sum-capacity is as follows (whose proof is immediate from (|7]i): 
Lemma 6: The sum-capacity using Han-Kobayashi schemes is upper bounded by 

, A 1 , 91 +.92i(p2 - '?2)\ , , , q2 + gi2{Pi - qi)\ 

opt2 = max log 1 + — + log 1 + — . (61) 

91.92 \ .92192 +iVi / V .91291+^2 / 

Computation of the upper bound ( 16 lb ." 
Note that 

log fl + 1^+92l{p2-q2)\ ^^f^ , 92 + .912^-1 - 91) 



\ 52192 + Ni J \ 51291 + ^2 

= log(9i + 521P2 + Ni) - log(5i29i + N2) (62) 
+ log(92 + 512P1 + ^2) - log(52i92 + Ni), (63) 

where ( |62] i is a function only of qi, and ( |63] l is a function only of q2. Clearly, max ( |62] i, s.t. < qi < pi and 
max ( |63] |. s.t. < q2 < P2 can each be solved by taking the first order derivatives, and checking the stationary 
points and the boundary points. ■ 

We combine the two upper bounds (ISTl i and (1611 as the following theorem: 

Theorem 3: The sum-capacity using Gaussian superposition coding-successive decoding is upper bounded by 
mill ( opt 1, opt2). 



C. Performance Evaluation 

We numerically evaluate our results in a symmetric Gaussian interference channel. The SNR is set to be 30di3. 
To evaluate the performance of successive decoding, we sweep the parameter range of a = iof(SNR^) ^ [^-^^ 1]' 
when a G [0,0.5], the approximate optimal transmission scheme is simply treating interference as noise without 
successive decoding. 

In Figure [TTl the simple translation by Algorithm 1 and the finer translation by Algorithm 2 are evaluated, and 
the two upper bounds derived above (ISTi . (I6TI 1 are computed. The maximum achievable sum-rate with a single 
message for each user {Li = L2 = 1) is also computed, and is used as a baseline scheme for comparison. 
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Fig. 11. Performance evaluation: achievability vs. upper bounds. 



We make the following observations: 

« The finer translation of the optimal deterministic scheme by Algorithm 2 is strictly better than the simple 
translation by Algorithm 1, and is also strictly better than the optimal single message scheme. 

• The first upper bound (ISTl i is tighter for higher INR (a > 0.608 in this example), while the second upper 
bound ( |6T1 ) is tighter for lower INR (a < 0.608 in this example). 

• A phenomenon similar to that in the deterministic channels appears: the sum-capacity with successive decoding 
of Gaussian codewords oscillates between the sum-capacity with Han-Kobayashi schemes and that with single 
message schemes. 

• The largest difference between the sum-capacity of successive decoding and that of single message schemes 
appears at around 1°^^^^^ = 0.64, which is about 1.8 bits. 

• The largest difference between the sum-capacity of successive decoding and that of joint decoding (Han- 
Kobayashi schemes) appears at around '°g(s1^R) = 0.74. This corresponds to the same parameter setting as 
discussed in Section Hl-BI (cf. Figure [3]). We see that with 30dB SNR, this largest sum-capacity difference is 
about 1.0 bits. 

For this particular case with SNR = 3QdB, the observed sum-capacity differences (1.8 bits and 1.0 bits) may not 
seem very large. However, the capacity curves shown with the deterministic channel model (cf. Figure |6} indicate 
that these differences can go to infinity as SNR — > oo. This is because a rate point dsym{ct) on the symmetric 
capacity curve in the deterministic channel has the following interpretation of generalized degrees of freedom in 
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Fig. 12. Sum-capacity differences: Han-Kobayaslii vs. successive decoding at a = 0.75, and successive decoding vs. tlie optimal single 
message scheme at a = 0.66. 



the Gaussian channel O), |l3|. 



a.,,„(INR,SNR ) 

SNR,INR^oo,i^fi|^=a Cau,g„(SNR) 



where Catiigri(SNR) = log(l + SNR), and Csy,ri(INR, SNR) is the symmetric capacity in the two-user symmetric 
Gaussian channel as a function of INR and SNR. 

Since Caujgn(SNR) — !> oo as SNR — > cxd, for a fixed a, any finite gap of the achievable rates in the deterministic 
channel indicates a rate gap that goes to infinity as SNR ^ oo in the Gaussian channel. To illustrate this, we plot 
the following sum-capacity differences in the Gaussian channel, with SNR growing from lOdB to 90dB: 

m The sum-capacity gap between Gaussian superposition coding - successive decoding schemes and single 
message schemes, with a = = 0.66. 

• The sum-capacity gap between Han-Kobayashi schemes and Gaussian superposition coding - successive de- 
coding schemes, with a = 1°^^^^^ = 0.75. 

As observed, the sum-capacity gaps increase asymptotically linearly with log SNR, and will go to infinity as 
SNR ^ oo. 



V. Concluding Remarks and Discussion 

In this paper, we studied the problem of sum-rate maximization with Gaussian superposition coding and successive 
decoding in two-user interference channels. This is a hard problem that involves both a combinatorial optimization 
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of decoding orders and a non-convex optimization of power allocation. To approach this problem, we used the 
deterministic channel model as an educated approximation of the Gaussian channel model, and introduced the 
complementarity conditions that capture the use of successive decoding of Gaussian codewords. We solved the sum- 
capacity of the deterministic interference channel with the complementarity conditions, and obtained the capacity 
achieving schemes with the minimum number of messages. We showed that the constrained sum-capacity oscillates 
as a function of the cross link gain parameters between the information theoretic sum-capacity and the sum-capacity 
with interference treated as noise. Furthermore, we showed that if the number of messages used by either of the two 
users is fewer than its minimum capacity achieving number, the maximum achievable sum-rate drops to that with 
interference treated as noise. Next, we translated the optimal schemes in the deterministic channel to the Gaussian 
channel using a rate constraint equaUzation technique, and provided two upper bounds on the sum-capacity with 
Gaussian superposition coding and successive decoding. Numerical evaluations of the translation and the upper 
bounds showed that the constrained sum-capacity oscillates between the sum-capacity with Han-Kobayashi schemes 
and that with single message schemes. 

Next, we discuss some intuitions and generalizations of the coding-decoding assumptions. 

A. Complementarity Conditions and Gaussian Codewords 

The complementarity conditions dZSl l. ( |26] | in the deterministic channel model has played a central role that leads 
to the discovered oscillating constrained sum-capacity (cf. Theorem [U. The intuition behind the complementarity 
conditions is as follows: At any receiver, if two active levels from different users interfere with each other, then 
no information can be recovered at this level. In other words, the sum of interfering codewords provides nothing 
helpful. 

This is exactly the case when random Gaussian codewords are used in Gaussian channels with successive 
decoding, because the sum of two codewords from random Gaussian codebooks cannot be decoded as a valid 
codeword. This is the reason why the usage of Gaussian codewords with successive decoding is translated to 
complementarity conditions in the deterministic channels. (Note that the preceding discussions do not apply to joint 
decoding of Gaussian codewords as in Han-Kobayashi schemes.) 

B. Modulo-2 Additions and Lattice Codes 

In the deterministic channel, a relaxation on the complementarity conditions is that the sum of two interfering 
active levels can be decoded as their modulo-2 sum. As a result, the aggregate of two interfering codewords still 
provides something valuable that can be exploited to achieve higher capacity. This assumption is part of the original 
formulation of the deterministic channel model |2], with which the information theoretic capacity of the two-user 
interference channel (cf. Figure |6] for the symmetric case) can be achieved with Han-Kobayashi schemes [51. 

In Gaussian channels, to achieve an effect similar to decoding the modulo-2 sum with successive decoding. Lattice 
codes are natural candidates of the coding schemes. This is because Lattice codebooks have the group property 
such that the sum of two lattice codewords can still be decoded as a valid codeword. Such intermediate information 
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Fig. 13. Ci paititioned into three paits for Lemma |2] 

can be decoded first and exploited later during a successive decoding procedure, in order to increase the achievable 
rate. For this to succeed in interference channels, alignment of the signal scales becomes essential fS). However, our 
preliminary results have shown that the ability to decode the sum of the Lattice codewords does not provide sum- 
capacity increase for low and medium SNRs. In the above setting of SNR = iQdB (which is typically considered 
as a high SNR in practice,) numerical computations show that the sum-capacity using successive decoding of lattice 
codewords with alignment of signal scales is lower than the previously shown achievable sum-rate using successive 
decoding of Gaussian codewords (cf. Figure [Til, for the entire range of a = logSNR ^ P-^' -'^l- reason is that 
the cost of alignment of the signal scales turns out to be higher than the benefit from it, if SNR is not sufficiently 
high. In summary, no matter using Gaussian codewords or Lattice codewords, the gap between the achievable rate 
using successive decoding and that using joint decoding can be significant for typical SNRs in practice. 

Appendix 

A. Proof of Lemma |2] and \3\ 

Proof of Lemma^ By symmetry, it is sufficient to prove for the case f2{x) = l,Vx G S2i, for some S2i that 
does not end at 1. 

Now, consider the sum-rate achieved within Ci ( |35] ). As shown in Figure [13] Ci can be partitioned into 
three parts: Cn = {/i(x)|si,s3,...,s2.-3: /2(a;)|s2,s4,...,s2.-2}' C12 = {h{x)\s^^_^,s2^+^j2{x)\s^^}, and C13 = 
{h{x)\s2i+3.-i h{x)\s2i+2-}^ (Cii,Ci2,Ci3 can be degenerate.) Note that 

• From the achievable schemes in the proof of Theorem [T] the maximum achievable sum-rate within Cn U C13 
can be achieved with f2{x) = 1, Vcc g S2 U S4 U . . . U 821-2 U S2i+2 U . . ., and = 0, Va; G Si U S3 U . . . U 

S2i-Z U S21+Z \J .... 

• By the assumed condition, f2{x) = l,Va; G S2i fi{x) = 0,Va; G S2i-i U S2i+i. 

Therefore, under the assumed condition, the maximum achievable sum-rate within Ci is achievable with {f2{x) = 
l,Vx- G 02, and /i(x-) = 0,Vx G ^i}. 
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Furthermore, from the proof of Theorem [T] we know that the maximum achievable sum-rate within C2 is 
achievable with {f-iix) = l,Va; G Qi, and fi{x) = 0,Va; G G-i}- Combining the maximum achievable schemes 
within Ci and C2, by letting {f2{x) = 1, V.t G [0, 1], and fi{x) = 0, Vx G [0, 1]}, a sum-rate of 1 is achieved, and 
this is the maximum achievable sum-rate given the assumed condition. ■ 
Proof of Lemma\3}i By symmetry, it is sufficient to prove for the case fi{x) = 0, Vx G S2i_i, for some 821-1- 

Now, consider the sum-rate achieved within Ci. As shown in Figure [141 Ci can be partitioned into three parts: 

Cii = {/i(a;)|si,s3,...,s2,_3>/2(a;)k,s4,. ..,82,-2}' C12 = /i(a;)|s2,_i, and C13 = {/i(a;)U2i+i,s2i+3,---) /2(a;)|s2,,s2i+2,...}> 
(Cii, C12, Ci3 can be degenerate.) Note that: 

■ From the achievable schemes in the proof of Theorem [T] the maximum achievable sum-rate within Cn U C13 
can be achieved with /2(a;) = 1, Vx G S2 U S4 U . . . U S2i-2 U S2i U . . ., and = 0, Va; G si U S3 U . . . U 

S2i-3 U S21+1 U . . .. 

• By the assumed condition, /i(.t) = 0,Va; G S2i-i- 
Therefore, under the assumed condition, the maximum achievable sum-rate within Ci is achievable with {f2{x) = 
l,Va; G 02, and fi{x) = 0,V.t G ^i}. 

Furthermore, from the proof of Theorem [T] we know that the maximum achievable sum-rate within C2 is 
achievable with {/2(x) = l,Va- G Qi, and Ji{x) = 0,Va; G Q2}- Combining the maximum achievable schemes 
within Ci and C2, by letting {f2{x) = l,Va; G [0,1], and fi{x) = 0,Vx G [0,1]}, a sum-rate 1 is achieved, and 
this is the maximum achievable sum-rate given the assumed condition. ■ 

B. Sum-capacity of Deterministic Asymmetric Interference Channels 

In this section, we consider the general two-user interference channel where the parameters nn, 71,22, ^^l2, ?^2i can 
be arbitrary. Still, WLOG, we make the assumptions that nn > n22 and rin = 1. We will see that our approaches 
in the symmetric channel can be similarly extended to solving the constrained sum-capacity in asymmetric channels, 
without and with constraints on the number of messages. 
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(65) 



From Lemma [T] it is sufficient to consider the following three cases: 

i) 5i > and 82 > 0; ii) Si > and 62 < 0; iii) Si < and 62 > 0. 

1) Sum-Capacity without Constraint on the Number of Messages: 

We provide the optimal scheme that achieves the constrained sum-capacity in each of the three cases in 
respectively. 

a) Si > and S2 > 0; 

This is by definition ( |23] ) equivalent to 7121 < 1 and 7122 > ni2- 

Case 1, 7122 > n2i'. 

Define /3i = 1 — ni2, (32 — ^^22 — '^21- As depicted in Figure [TSl interval /i(= [0, 1]) is partitioned into segments 
{si, S2, S3, . . .}, with |si| = I S3 1 = ... = Pi and |s2| = |s4| = ... = j32\ the last segment ending at 1 has 
the length of the proper residual. Interval l2{= [1 — ?t-22, 1]) is partitioned into segments {s'j^, S2, S3 . . .}, with 
Nil ^ 1*3! = • ■ • = /^2 and |s2| = IS4I = ... = /3i; the last segment ending at 1 has the length of the proper 
residual. 

Similarly to (l35T l as in the previous analysis for the symmetric channels, we partition the optimization variables 

./i (2^) I [0.1] and /2(a;)|[i_„22,i] into 

Ci = {h{x)\s^.s^....j2{x)\s'^,s'^,..} and C2 = {fi{x)\s^.s^,...j2{x)\s'^,s'^,..}- (66) 



Userl 



User 2 




Fig. 15. nil > ^21, n22 > n.12, and n22 > "21. 



As there is no constraint between Ci and C2 from the complementarity conditions (|25> and 
and (IJTI i. the sum-rate maximization (IZTl i is decomposed into two separate problems: 



max 

/l(a:)Ui,»3,...,/2(a;) 



subject to (|24l), (|25]l, ( l26l l. 



/i(a:;)dx + 



f2{x)dx 



, similarly to 



(67) 



max 

/l(^)U2.»4,-'/2(^) 



subject to dm, (|25ll, (|26] |. 



/i (a;)d.T 



f2{x)dx 



(68) 
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By the same argument as in the proof of Theorem [T] the optimal solution of ( |67] i is given by 



/i(a;) = l,Va;esiUs3U 



, and /2(x) = 0, Vx e S2 U S4 U . . . . 



(69) 



Also, the optimal solution of ( |68] l is given by 



fi{x) = 0,Va; e S2 U S4 U 



, and /2(.t) = 1, Vx e s'l U S3 U . . . . 



(70) 



Consequently, we have the following theorem: 

Theorem 4: A constrained sum-capacity achieving scheme is given by 




0, otherwise 





1, Va- e s'l Usg U . . . 

0, otherwise 



(71) 



and the maximum achievable sum-rate is readily computable based on dTlT l. 
Case 2, n2i > n22- 

Define /3i = 1 — ni2 — (77,21 ~ "■22)- As depicted in Figure [16] interval /i(= [0, 1]) is partitioned into segments 
{sq, Si, S3, S5, . . .}, with |so| = 7121 —"-22, and |si | = jssj = . . . = /3i; the last segment ending at 1 has the length of 
the proper residual. Interval l2{= [1 — 7722, 1]) is partitioned into segments {s2, S4 . . .}, with |s2| = IS4I = . . . = 
the last segment ending at 1 has the length of the proper residual. (The indexing is not consecutive as we consider 
{s2i} and {s2,_i} {i > 1) as degenerating to empty sets.) 



Fig. 16. nil > "21, "22 > "12, and "21 > n22. 

Clearly, sq of Ii does not conflict with any levels of I2, and thus we let fi{x) = 1,V.t G sq. On all the other 
segments, the sum-rate maximization problem is 




n2i\ 




AT 

022 




subject to (EHi, (l25]l, ( |26] |. 



By the same argument as in the proof of Theorem [T] the optimal solution of ( |72] | is given by 



fi{x) = l,Va; G si U S3 U . . ., and /2(.t) = 0, Vx G S2 U S4 U . . . . 



Thus, a sum-capacity achieving scheme is simply fi{x) = l,Va; G /i, and /2(x) = 0,Vx G l2- 
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b) Si >0 and S2 < 0; 

This is by definition (l23T l equivalent to 7121 < 1 and 7122 < ?^l2■ Note that by Lemma [T] it is sufficient to only 
consider the case where \Si \ > \S2\, (because in case \Si \ < \52\, we have | — ^2! > | — <^i|-) 

Case 1, 7122 > "-21, and ni2 > 1: 

Define /3i = 71-22 — ^21 — {ni2 — !)• As depicted in Figure [iTl interval [0, 1]) is partitioned into segments 
{si, S3, . . .}, with |si| = jsal = . . . = the last segment ending at 1 has the length of the proper residual. Interval 
^2(= [1 — "-22, 1]) is partitioned into segments {s'q, Sj, S4 • ■ with |sq| = 77,12 — 1 and jsj] — \s'j^\ = . . . = (3i; the 
last segment ending at 1 has the length of the proper residual. 



User1 



User 2 



Si 




S3 








\ 1 \ \^ 

\ 1 \ 
\i \ 

\ \ 
i\ \ 

1 \ \ 




P. 


\ni2"-- 


''..n2i 






P. 






Pi 




;VoiL-._ 


S2' 




S4' 


S6'___^ 





ni2-1 n22 



Fig. 17. nil > n2i, 7122 < n.12, 7122 > »72i, and ni2 > Tin. 



Clearly, Sq of I2 does not conflict with any levels of Ii, and thus we let f2{x) — 1,V.t G Sq. On all the other 
segments, the sum-rate maximization problem is again (l72t . and the optimal solution is given by 

fi{x) = l,Vx G Si U S3 U . . ., and /2(.t) = 0, Va; G Sj U S4 U . . . . 

f 1, Vx G sj, 

Thus, a sum-capacity achieving scheme is fi{x) = l,\/x G /i, and f2{x) = < 

I 0, otherwise 

Case 2, 7122 > 77,21, and 7712 < 1: 

Define /3i = 1 — 7712, 1^2 — 7722 — 7721. As depicted in Figure [Tsl interval [0, 1]) is partitioned into segments 
{si, S2, S3, . . .}, with |si| = |s3| = . . . = f3i and |s2| = |s4| = ... = f32', the last segment ending at 1 has 
the length of the proper residual. Interval /2(= [1 — 7122,!]) is partitioned into segments {s'l, S2, S3 . . .}, with 
kil — I'^sl = • ■ • = P2 and IS2I = \s'^\ = ... = Pi; the last segment ending at 1 has the length of the proper 
residual. 

Compare with Case 1 of Section IBlal and note the similarities between Figure [18] and Figure [15] we apply the 
same partition of the optimization variables ((66), and the sum-rate maximization (IZTT i is decomposed in the same 
way into two separate problems (i67] i and (168) . However, while the optimal solution of ( i67] i is still given by ( i69l l. 
the optimal solution of ( |68] | is no longer given by dTOl i. Instead, as 82 < 0, the optimal solution of (i68T l is given by 

/i(a;) = 1, Vx G S2 U S4 U . . . , and /2(x) = 0, Vx G s'l U S3 U . . . . 
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Fig. 18. nil > ri2i, n22 < ^12, 1222 > ^21, and ni2 < rin, scheme I (non-optimal). 



Thus, a sum-capacity achieving scheme is given by fi{x) = l,Va; G Ii, and 72(2;) = 0,Vx G /2, depicted as in 
Figure [T9] 



User 2 





Si S2 S3 S4 







\ M^rVvA — V 

V\ \ "'\ V\ \ n2i 


1 





— S2' S3' S4' ^^^^^^^--^'^ 


1 



n22 



Fig. 19. nil > n2i, n22 < ni2, n22 > n2i, and ni2 < nn, scheme II (optimal). 
Case 3, 7122 < n2i' 

Compare with Case 2 of IBlal (cf. Figure [16), with the same definition of /?i and the same partition of Ii and 
I2, the segmentation is depicted in Figure l20l 

□21 - n22 



User 2 





So 1^ Si 


S3 



















V 
\ ni2 

nit. 










Pi ■ 


'\ Pi 













S4' 





n22 



Fig. 20. nil > n2i, n22 < ni2, and n22 < "21. 

Noting the similarities between Figure [16] and Figure [20] we see that the optimal solution of the two cases are 
the same: /i(a:;) = l,Va; G /i, and f2{x) = 0,Vx G l2- 
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c) Si < and 62 > 0; 

This is by definition ( |23] l equivalent to n2i > 1 and n22 > ni2- Note that by Lemma [T] it is sufficient to only 
consider the case where \6i\ < \S2\, (because in case \Si\ > \62\, we have | — <52| < | ^ <^i|-) 

Define /3i = 1 — ni2 — (71.21 — "■22)- As depicted in Figure [JT] interval /i(= [0, 1]) is partitioned into segments 
{so, si, S3, S5, . . .}, with |so| = n2i —7122 and |si| = jsal = . . . — (3i; the last segment ending at 1 has the length of 
the proper residual. Interval l2{= [1 — 7122, 1]) is partitioned into segments {sj, S4 . . .}, with \s2\ = \s'^\ = . . . = (3i; 
the last segment ending at 1 has the length of the proper residual. 
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User 2 
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Si S3 S5 




0/1 

/ 1 

1 ' 




/ / / / / "12 

/ /ri2i / / 

/ /A / / 


^ 1 


P-'T I'' Pi P. . 


1 




S4' 


1 



Fig. 21. nil < 7121 and 7222 > ^12. 

Clearly, sq of 1\ does not conflict with any levels of I2, and thus we let = 1,V.t G sq. On all the other 

segments, the sum-rate maximization problem is again (iTZt . As b\ < 0, the optimal solution is given by 

fi{x) = 0,Va; e si U S3 U . . ., and /2(.t) 1, Va; G S2 U S4 U . . . . 

I 1, Vx G So 

Thus, a sum-capacity achieving scheme is fi{x) ~ < , and f2\x) ~ l,Va; G l2- 

I 0, otherwise 

Summarizing the discussions of the six parameter settings (cf. Figures [15] - [17] and [19] - I2TI 1 in this subsection, 
we observe: 

Remark 6: Except for Case 1 of Section iBlal the optimal schemes for the other cases all have the property that 
only one message is used for each user. 

2) The Case with a Limited Number of Messages: 

In this subsection, we extend the sum-capacity results in Section IIII-B2I to the asymmetric channels when there 
are upper bounds on the number of messages Li , L2 for the two users respectively. From Remark we only need 
to discuss Case 1 of Section IBlal (cf. Figure [15]) with its corresponding notations. 

Similarly to the symmetric channels, we generalize Lemma |2] and [3] to the following two lemmas for the general 
(asymmetric) channels, whose proofs are exact parallels to those of Lemma [2] and [3] 

Lemma 7: 

1. If 3s2i, S2i does not end at 1, such that fi{x) = IjVx G S2i, then i?^"™ < l. 

2. If 3s2j, Sjj does not end at 1, such that f2{x) = l,Va; G Sj^, then i?*'™ < 77,22- 
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Lemma 8: 

1. If 3.S2i-i, such that = 0,V:r G S2i-i, then i?^"™ < 7132. 

2. If 3s'2,,_i, such that /2(.t) = 0,V.t e s'^^_^, then i?""™ < 1. 

We then have the following generalization of Theorem |2] to the general (asymmetric) channels: 

Theorem 5: Denote by Li the number of messages used by the i*-^ user in any scheme, and denote by rii the 
dictated number of messages used by the i*'' user in the constrained sum-capacity achieving scheme (iTll . Then, if 
Li<ni-l or L2<n2- 1, we have i?'*"™ < 1. 

Proof: Consider L2 < n-z — 1. (The case of Li < ni — 1 can be proved similarly.) 

i) The sum-rate of 1 is always achievable with 

/i(x) = l,Vxe/i,/2(a-)=0,Va;G/2. 

ii) If there exists Sji: (* ^ 1) ^nd does not end at 1, such that f2{x) = l,Va; G Sjj, then from Lemma |2l 

i?""™ < 7122 < 1- 

iii) If for every Sj,, i > 1 and does not end at 1, there exists Xi in the interior of such that f2{xi) = 0: 
For every Xi, since does not end at 1, S2i^i exists. Note that Xj separates the two segments S2j_j,S2i+i 

for the 2'"^ user From Remark |3] S2j_i and S2j+i have to be two distinct messages provided that both of them 
are (at least partly) active for the 2"'* user On the other hand, there are 712 such segments {s[, Sg, . . . , S2n^_i}, 
whereas the number of messages is upper bounded by L2 < n2 — 1. Consequently, 31 < 72 < 712, such that 
f2{x) = 0, Vx G S2i2-i- In other words, for the 2"'' user, there must be a segment with an odd index that is fully 
inactive. By Lemma [8] in this case, i?'*"™ < l. ■ 
Similarly to the symmetric case, we conclude that if the number of messages used for either user is fewer than 
the number used in the optimal scheme ( ItTI i. the maximum achievable sum-rate drops to 1. 

C. Proof of Lemma |4] 

At the receiver, the message x^^^ is decoded by treating all other messages (x^-* , . . . , x^^^ , x^2^ , ■ • ■ , x'"^'^) as 



noise, and has an SNRi of 7^ — nrv^ ^r^- 

At the 2'"^ receiver, Xj^'' is first decoded and peeled off. Suppose x^-^'^ is also decoded at the 2'"^ receiver (by 
treating x^i\...,x^i \ Xj^^ . . . , Xj^^ as noise,) it has an SNR2 of g^^(p_p(i|)'^y_p(i))_|_i ■ To equalize the rate 
constraints for x^^'' at both receivers, we need 

SNRi = SNR2 ^ = 1 - gi2 + (1 - 5?2)P- 

Note that p^^^ < p requires that p > . Otherwise, p < , and the above 1 — 912 + (1 — gi2)p > P- It 

implies that we should not decode x'"-^^ at the 2"'' receiver, i.e., xf'\i = 1,2) is the only message (L = 1) of the 
7*'' user, which is treated as noise at the other receiver 
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